Flexible method for processing data packets in a network routing system for enhanced efficiency and monitoring capability

ABSTRACT

According to an embodiment of the invention, a network device such as a router or switch provides efficient data packet handling capability. The network device includes one or more input ports for receiving data packets to be routed, as well as one or more output ports for transmitting data packets. The network device includes an integrated port controller integrated circuit for routing packets. The integrated circuit includes an interface circuit, a received packets circuit, a buffer manager circuit for receiving data packets from the received packets circuit and transmitting data packets in one or more buffers and reading data packets from the one or more buffers. The integrated circuit also includes a rate shaper counter for storing credit for a traffic class, so that the integrated circuit can support input and/or output rate shaping.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a division of U.S. patent application Ser.No. 10/140,752 filed on May 6, 2002, which is incorporated herein byreference.

FIELD OF THE INVENTION

The present invention relates to routing in a computer network. Moreparticularly, the present invention relates to a system for efficientlyrouting and monitoring packets in a computer network.

BACKGROUND

Modern networking environments provide enormously enhanced datatransmission capabilities over environments available only a few yearsago. However, the demand for bandwidth is constantly increasing, as isthe demand for more routing and monitoring capabilities. In order tomeet this demand, network devices such as routers need to increase thenumber of ports serviced and the features they provide.

For example, network devices need to implement Quality of Service (QOS)features, which can provide better and more predictable network serviceby ensuring a dedicated bandwidth to be available, improving losscharacteristics, avoiding and managing network congestion, shapingnetwork traffic, and setting traffic priorities across the network.Currently, many QOS features are implemented using software. However,software implementation is impractical for the large bandwidth routersneeded to handle the increasing amount of network traffic. Similarly,network devices need to be able to route broadcast or multicast packetsand jumbo packets, and to provide network monitoring capability.

Therefore, there is a need for a large bandwidth network device that canefficiently route packets with, for example, “the Internet protocol”(IPv4) type of service (TOS) fields for QOS services. Additionally, thenetwork device should efficiently route jumbo packets and broadcast ormulticast packets (including multicast packets with different VLAN IDs).Finally, the network device should be configured to perform networkmonitoring without the use of additional probes.

SUMMARY

According to an embodiment of the invention, a network device such as aswitch or a router provides large bandwidth as well as efficiency fordata packet handling capability. The network device includes multipleinput and output ports for receiving and transmitting data packets.According to an embodiment, the network device performs switching orrouting of data packets for numerous auto-sensing multi-speed (10/100megabit) Ethernet ports and very high speed (e.g., gigabit) ports.According to another embodiment, the network device performs switchingor routing of data packets for multiple very high speed ports.

According to one embodiment, the network device provides a portcontroller integrated circuit for switching or routing packets. Theintegrated circuit includes a packet input circuit for receiving datapackets from at least one of the input ports, and a buffer managercircuit for receiving data packets from the packet input circuitry,transmitting data packets to one or more buffers, and reading datapackets from the one or more buffers. The integrated circuit alsoincludes a rate shaper counter for storing credit for a traffic class,so that the integrated circuit can support input and/or output rateshaping.

The integrated circuit may be implemented as an application specificintegrated circuit (ASIC) or in a programmable logic device (e.g., anFPGA). The input ports may be 10/100 megabit Ethernet ports, gigabitEthernet ports, Packet over SONET (POS) ports, ATM ports, or otherports. The packet input circuitry is configured to provide an interfacewith the appropriate port type.

The integrated circuit may be associated with one or more memories whichprovide a buffer pool for storing data packets. In some embodiments, thebuffer pool is implemented using a random access memory (RAM). (Thebuffer pool is sometimes also referred to as an IRAM.) In otherembodiments, other types of memory may be used. The integrated circuitmay be associated with one or more content-addressable memories (CAMs)for storing information about the packets (“packet information”) beinghandled in a memory array. The integrated circuit may include a CAMinterface used to perform lookups on the CAM.

In one embodiment, the integrated circuit may be associated with anadditional memory provided for storing packet parameters (“PRAM”). EachPRAM stores packet information in a memory array, including switching orrouting parameters. The integrated circuit may include a PRAM interfaceused to perform lookups on the PRAM. The PRAM may be sized to providevalues of a predetermined set of packet parameters for each CAM entry.

The integrated circuit may further include an aging RAM, which storesaging information regarding the CAM and PRAM entries. The aginginformation may be used by a host CPU, which may be coupled to theintegrated circuit via a system interface circuit, to determine forremoval entries from either the CAM, the PRAM, or both, when an agecount exceeds an age limit threshold for the entries. Age counts areincremented periodically for a CAM entry, unless the entry isreferenced, which resets its age count.

The integrated circuit may include a packet evaluation circuit. Thepacket evaluation circuit may include a port tracker circuit. The packetevaluation circuit may also include a programmable lookup processor,which may be a RISC processor. The programmable lookup processor mayinclude a register file, a register select circuit for selecting thecontents of registers as operands, an arithmetic logic unit foroperating on the operands, and a feedback select circuit for providing,alternatively, as operand an output value of the ALU. In one embodiment,the register file is configured such that some of the registers areassigned to particular packet parameters, such that a snapshot of theregister file provides without further processing a key for a CAMlookup. The output value of the ALU may be written into one or more ofthe registers.

The packet evaluation circuit may also include a CAM lookup handler forsubmitting lookup requests to the CAM, and a PRAM lookup handler forsubmitting lookup requests to the PRAM based on the values returned froma CAM lookup. The packet evaluation circuit may include packetevaluation logic circuits for performing packet processing using theresults of a CAM lookup and a PRAM lookup.

The port tracker circuit may identify valid packet contexts (to filtercorrupted packet data), copy a VLAN tag to a status word, and remove aVLAN tag from a packet header, in order to facilitate packet processing.The port tracker circuit may also perform TOS field lookups under theIPv4 protocol, or another suitable protocol.

The packet input circuit may include an 8B/10B decoder. Additionally,the packet input circuit may include logic circuits for CRC verificationand auto-negotiation.

The integrated circuit may further include a polling logic circuit,which may perform time slot polling of the input ports of the networkdevice. The integrated circuit may further include a received data FIFOcircuit to receive data packets from the polling logic circuit. Theintegrated circuit may further include an internal VLAN table.

The buffer manager circuit may perform rate shaping, including inputrate shaping and output rate shaping. The rate shaping may be based onport, both port and priority, or

L3/L4 (network level) information. The buffer manager circuit may alsobe configured to route jumbo packets, which are variable-length packetsfor very high speed ports.

A priority may be assigned to a data packet by default, and according towhether the data packet is specified with a VLAN priority or a TOSpriority. The packet priority may be further modified from the resultsof a CAM lookup or a PRAM lookup.

The processed data packet may be transferred to a buffer in an IRAM bythe buffer manager circuit for forwarding. The buffer manager circuitmay perform rate shaping. Rate shaping may be achieved by definingtraffic classes, and storing credit in a counter corresponding to thetraffic class. Credits are added to each counter periodically accordingto a credit interval. The amount of additional credit added to eachcounter may be different. The amount of credit is decreased when thebuffer manager forwards a packet for the traffic class.

An interface adapter may be used with a port controller integratedcircuit as described above, in order to interface multiple portcontroller integrated circuits with a backplane having multiplebackplane slots. The interface adapter may provide data rate matchingwhere the combined bandwidth of the multiple port controller integratedcircuits is different from the bandwidth of the backplane. The interfaceadapter may transmit packets to and receive packets from any of thebackplane slots and any of the port controller integrated circuits. Thereceived data packets and the data packets to be transmitted may bestored in backplane queues. A buffer manager may be provided in theinterface adapter for managing buffers used to mediate data packettraffic among the backplane and the port controller integrated circuits.A backplane RAM can be provided to provide buffers for storing datapackets in transit among the backplane slots and the port controllerintegrated circuits.

A more complete understanding of the present invention and itsadvantages will be afforded to those skilled in the art uponconsideration of the following detailed description of the exemplaryembodiments therein. Reference will be made to the appended drawing thatwill first be described briefly.

BRIEF DESCRIPTION OF THE DRAWING

FIG. 1 is a block diagram of router 10, which includes an integratedport controller, according to an embodiment of the invention;

FIG. 2 is a block diagram of router 20, which includes two integratedport controllers, according to another embodiment of the invention;

FIGS. 3A and 3B are block diagrams of two configurations in routerswhere multiple integrated port controllers may be connected, accordingto other embodiments of the invention;

FIG. 4 is a block diagram of a port controller ASIC that may be used ina network device, such as the routers of FIGS. 1, 2, 3A, and 3B,according to an embodiment of the invention;

FIG. 5 is a block diagram of packet evaluation circuit 500, suitable forimplementation in packet input circuit 410 shown in FIG. 4, according toan embodiment of the invention;

FIG. 6 is a block diagram of processor 600, which is one implementationof PLP 530 of FIG. 5, according to an embodiment of the invention;

FIG. 7 shows process steps that may be performed using a router toassign a priority to a packet, according to an embodiment of theinvention; and

FIG. 8 is a block diagram of interface adapter ASIC 800 that may be usedin a router such as that shown in FIG. 3B, according to an embodiment ofthe invention.

Use of the same or similar reference numbers in different figuresindicates the same or like elements.

DETAILED DESCRIPTION

According to an embodiment of the invention, a network device includesone or more integrated port controllers, each implemented in anintegrated circuit such as an application specific integrated circuit(ASIC) or a field programmable gate array (FPGA), to manage and monitorpacket flow efficiently.

Network Device with Integrated Port Controller

In FIG. 1, a network device such as a router 10 includes a portcontroller ASIC 100. Data packets are transmitted to input terminals 60of port controller ASIC 100 via physical interfaces 50. Input terminals60 to ASIC 100 may be provided by media access controller (MAC)circuits, for conventional 10/100 megabit Ethernet ports, or may beprovided by serializer/deserializer (SERDES) circuits, for gigabitEthernet ports. Router 10 may support other types of ports, such as POSports, ATM ports, or other ports. According to an embodiment of theinvention, ASIC 100 has twenty four 10/100 megabit Ethernet ports andtwo gigabit Ethernet ports. According to an alternate embodiment, ASIC100 has four gigabit Ethernet ports. In one embodiment, each port isprovided a 48-bit MAC address of which the upper 32 bits are common toall the ports, and the remainder 16 bits of the MAC address areprogrammable.

ASIC 100 may be associated with one or more memories, such as anintegrated packet controller memory (“IRAM”) 120, aging memory 130,parameter memory (PRAM) 140, and content addressable memory (CAM) 150.(Functions of these memories are explained in further detail below).IRAM 120, aging memory 130 may be implemented by random access memories.Although FIG. 1 shows ASIC 100 to be associated with one memory of eachtype listed above, in other embodiments more than one memory of a giventype may be provided. ASIC 100 is also associated with a systeminterface chip 200, which in turn is associated with one or morememories such as memory 220 and 230 of FIG. 1. System interface chip 200provides an interface between ASIC 100 and a host CPU 300.

ASIC 100 may interact with its associated memories as follows. ASIC 100provides to CAM 150 packet information extracted from a packet receivedinto ASIC 100, to initiate a search in CAM 150 to determine how toforward the packet to its destination and to initiate other packetprocessing functions. If a match is found, CAM 150 returns correspondingparameter values; in addition, or alternatively, CAM 150 returns anindex into another memory array, where the corresponding data is stored.For example, in a destination address (DA) search, ASIC 100 uses thereturned index to retrieve forwarding data from PRAM 140. For a sourceaddress (SA) search, ASIC 100 uses the returned index to retrieve sourceport information from PRAM 140, which is then used to age CAM entries.

PRAM 140 includes additional information for further processing thepacket. PRAM 140 may be implemented by a 32-bit synchronous DRAM(SDRAM), sized to match CAM 150. According to an embodiment of theinvention, PRAM 140 includes four separate tables implemented indifferent SDRAM banks. Destination address table records are in onetable, source address table records are in another table, L3 (networklevel) records are in another table, and L4/session (network/sessionlevel) records are in another table. This banked table structure permitsCAM lookups according to many supported packet types to receivedifferent services at different levels. The associated PRAM data providedestination address/source address lookups and support networkmonitoring and management functions.

According to an embodiment of the invention, PRAM 140 implements addressaging, which allows a CPU such as CPU 300 of FIG. 1 to remove unusedentries from the CAM and PRAM memory arrays. An age bit, including anage count and an age-disable flag, is stored in a PRAM record, as wellas in a separate AGERAM record on aging RAM 130. PRAM 140 also includesan aging configuration register, which may be set with an agingthreshold.

When CAM 150 performs a successful address lookup (that is, locates amatching entry in the CAM array), a PRAM lookup cycle at that CAM indexis performed. The information retrieved from PRAM 140 is incorporatedinto the 16-byte packet status word, and the age count may be zeroed,which is performed after a source address lookup in this embodiment. Ifthe age count is zeroed, it is zeroed both in the PRAM record and theAGERAM record. The aging function is initiated by CPU 300, whichcommences an aging cycle by issuing an age cycle command to ASIC 100.When the age cycle command is received, an aging controller on ASIC 100scans the AGERAM entries, incrementing the age count whenever theage-disable flag is not set, and the age value is less than an age-limitthreshold in the PRAM aging configuration register. An active agingcycle is indicated in the status field of the PRAM control register.PRAM entries that age-out (the age count exceeds the age-limitthreshold) have their indices stored in an aging FIFO, so that CPU 300can take appropriate action; for example, over-writing the CAM and PRAMindices.

Once all required packet type decoding, CAM, and PRAM lookups arecomplete, a buffer manager controller such as buffer manager controller440 of FIG. 4 transfers packets to one or more buffers in IRAM 120.Buffer manager controller 440 is discussed in further detail below.

FIG. 2 shows another embodiment of the present invention in router 20,which includes two port controller integrated circuits to providessupport for more input ports and hence a higher traffic level thanrouter 10 illustrated in FIG. 1. Router 20 includes port controllerintegrated circuits (i.e., port controller ASICs) 100-1 and 100-2. ASIC100-1 and 100-2 are each interfaced to ports (i.e., port input terminals60-1 and 60-2) and associated with memories (e.g., IRAM 120-1, aging ram130-1, PRAM 140-1, and CAM 150-1 are associated with ASIC 100-1, whileLRAM 120-2, aging ram 130-2, PRAM 140-2, and CAM 150-2 are associatedwith ASIC 100-2) in the same manner as described above for ASIC 100 ofFIG. 1. Router 20 also includes a system interface chip 200 whichprovides an interface between CPU 300 and each of ASICs 100-1 and 100-2.

FIGS. 3A and 3B show other configurations of port controller integratedcircuits for network devices capable of handling even greater packettraffic levels. FIG. 3A shows four port controller integrated circuitssuch as ASIC 100 of FIG. 1, coupled via a switch such as a crosspointswitch 320. FIG. 3B shows an alternate configuration, where four portcontroller integrated circuits such as ASIC 100 of FIG. 1 are coupled toa backplane of another router, through an interface adapter integratedcircuit. The interface adapter integrated circuit may be implemented asan ASIC such as an interface adapter ASIC 800 of FIG. 3B.

FIG. 4 is a block diagram of an embodiment of a port controllerintegrated circuit such as ASIC 100 of FIG. 1. As shown in FIG. 4, ASIC100 includes packet input circuit 410, which is configured to interfacewith gigabit ethernet media access channel (GMAC) ports and may containan 8B/10B encoder/decoder and logic circuits for CRC verification, andauto-negotiation. In addition, packet input circuit 410 may beconfigured to interface with conventional 10/100 Ethernet media accesscontroller (MAC) ports. Packet input circuit 410 may additionallyreceive packet transfers and perform time-slotting of transmit packettransfers. For example, packet input circuit 410 may receive packettransfers in bursts of sixteen cycles. In some embodiments, packet inputcircuit 410 may be configured to interface with other ports such as ATMports or POS ports, or may be a combination of different interfacetypes.

Besides forwarding packets to their destinations, packet input circuit410 performs further functions. Packet input circuit 410 may beconfigured to perform packet classification, prepare packetmodifications, and generate packet headers, which are functions that canbe used to support routing at higher protocol levels, network trafficmanagement and monitoring. Further, packet input circuit 410 preparessixteen-byte encapsulation, which used in forwarding packets throughrouter 10. In FIG. 4, packet input circuit 410 is implemented inseparate blocks for each input port. According to other embodiments, asingle block may provide input circuitry for a single input port, or formore than one input port. Input circuitry 410 may be different fordifferent input port types, or only a sub-unit of input circuitry 410may be different.

FIG. 5 is a block diagram of packet evaluation circuit 500, which may beincluded in packet input circuit 410 or elsewhere on ASIC 100. As shownin FIG. 5, a received packet is received into port tracker 510. Porttracker 510 performs “sanity” checks on the data packet received intoASIC 100 through, for example, one of the MAC interfaces, such asidentifying valid packet contexts (e.g., consistent start of packet andend of packet boundaries) and examining the status word appended by theMAC, which indicates any data faults. In addition, port tracker 510strips virtual local area network (VLAN) tags, and places a copy of thefirst 60 bytes of packets into header first-in-first-out (FIFO) memory520, and a copy of the entire packet into packet data FIFO memory 560.Port tracker 510 may also perform some basic packet decoding, such ascomparing the packet MAC destination address (DA) against the port MACaddress, and checking the Ethernet Type field to determine whether thereceived packet has a VLAN tag. If DA matches the port MAC address, aninternal status bit (“RX_US”) is set. Based on this internal status bit,a data packet having a DA in ASIC 100 is routed to CPU 300. According toan embodiment, the VLAN ethertype field is fully programmable. When areceived packet has a VLAN tag, the VLAN tag is copied from the headerinto a 16-byte packet status word, then removed from the packet header,so that packet processing in some portions of packet evaluation circuit500 can proceed without regard to whether the packet is associated witha VLAN. For IPv4 type packets, port tracker 510 may also perform TOSfield lookups, to enable input and output rate shaping (see below). Theresults of all evaluations are placed into bytes 60-63 of the packetheader data.

Received packet headers are forwarded to received packet header FIFOmemory 520. In an embodiment, received packet header FIFO memory 520 hasa capacity of 256×36 bits. Received packet data is forwarded to areceived packet data FIFO memory 560. According to an embodiment,received packet data FIFO memory 560 has a capacity of 256×36 bits.

Packet header data is forwarded from received packet header FIFO memory520 to a programmable lookup processor (PLP) 530 for further processing.PLP 530 forms CAM lookups, creates part of the 16-byte packet header forthe outgoing packet to be forwarded, and generates information neededfor packet evaluation to function properly. Based on packet type (e.g.,IP, IPX or L2), PLP 530 also computes a trunk index to support trunking.This trunk index is used to logically 'ORed with a MAC destinationaddress FID.

In one embodiment, PLP 530 is a 16-bit RISC processor, able to accessanything from the first 60 bytes of a packet. A program drives thespecific operations of PLP 530, which directs the types of CAM lookupsto be carried out, according to the packet type and values of systemparameters. Some registers in the RISC processor of that embodiment areassigned to specific parameters that comprise the packet context, sothat their contents can directly compose specific L2/L3/L4 CAM targetsor contain packet header fields. Once processing is complete the packetcontext is transferred to the CAM lookup handler 540.

FIG. 6 is a block diagram of processor 600, which is one implementationof PLP 530 of FIG. 5. Processor 600 includes register file 610, registerselect block 620, feedback select block 630, and arithmetic logic unit(ALU) 640. In an embodiment, register file 610 includes thirty onegeneral purpose 16-bit registers and one program counter register. Theregisters can be freely used during evaluation to perform any operation.However, once evaluation is complete the register contents can bedirectly used for CAM targets and packet header information.

Register select block 620 chooses a target register's contents fromregister file 610 as operands into ALU 650. Feedback select block 630,which selects either the operands from the register select block 620, oran output value of ALU 620, permits back-to-back use of modifiedregisters. In this implementation, the registers in register file 610are pipelined such that a write operation into a register in registerfile 610 takes two processor clock cycles. However, if processor 640detects that a result from ALU 640 is used in the following instruction,feedback select block 630 selects the result from ALU 640 as operand forthis following instruction, rather than from register file 610. ALU 640supports load and store operations, and arithmetic and logic binaryoperators including and, or, xor, neg, add, compare, inline rotate andmask operations. Constants, or immediates, can be substituted forregister values in places.

Once PLP 530 completes its operation, the contents of register file 610are transferred to CAM lookup handler 540. CAM lookup handler 540 takesa snapshot copy of all the PLP registers and submits these values toinitiate one or more CAM look-up requests via CAM interface 545. WithCAM lookup handler 540 controlling CAM lookup operations, PLP 530 canbegin to work on another packet. When the CAM returns the lookupresults, the context is transferred to a PRAM lookup handler 550.

Like CAM lookup handler 540, PRAM lookup handler 550 is also aplaceholder. Specifically, PRAM lookup handler 550 maintains the packetcontexts while PRAM lookups are performed. CAM handler 540 and PRAMlookup handler 550 allow a pipelined operation in the units of packetevaluation circuit 500, so that useful work (instead of stalling) iscarried out while the memory accesses (e.g., such as PRAM datatransfers) are performed. PRAM lookups are submitted to the PRAM viaPRAM interface 555. After PRAM lookups are complete, further packetprocessing may be performed in packet evaluation block 590.

In most packet types, CAM lookups are carried out for the destinationaddress and the source address. Additional lookups may be carried outfor some packet types. For example, if the packet type is IPv4 or IPX,another CAM lookup (for level 3, or network layer routing information)may be done. If the packet type is IPv4, a level 4 or session lookup mayalso be carried out. After a successful CAM lookup, a PRAM lookup may beperformed to obtain additional information used in packet forwarding.During the CAM and PRAM lookups, a number of status word flags may beset up, as an aid to software packet forwarding, hardware packetforwarding, or both. For some packet forwarding, the destination addressmay be replaced, or the packet header may be modified, or both in orderto support hardware packet routing.

Received IRAM port handler 580 transfers data in received packet dataFIFO 560 to received IRAM accumulator block 570, which is then providedto HUM 120 (FIG. 1). In one embodiment, a separate IRAM port handlerhandles packets for each of ports 60. According to one embodiment, IRAMaccumulator block 570 handles read data from port receive FIFOs in 32byte chunks, applying packet modifications, and dumping data into anIRAM received FIFO. It also detects the end of packet, and builds RXDONEmessages for buffer manager controller 440 of FIG. 4 (described infurther detail below). If a packet is flagged as bad (for example, dueto an invalid CRC), buffer manager controller 440 re-circulates thebuffer directly into a freelist.

Referring again to FIG. 4, received packets are forwarded from packetinput circuit 410 to packet routing circuit 420. In one embodiment,packet routing circuit 420 may includes a packet polling circuit, whichperforms time slot polling of the input ports for received packet data.In FIG. 4, the packet polling circuit is included in packet pollinglogic block 415, which is shown as part of packet routing circuit 420.In other embodiments, the packet polling logic circuit may be locateddifferently on ASIC 100. In one embodiment, packet data is accumulatedinto 128 bit words and forwarded by packet routing circuit 420 to abuffer pool in IRAM 120 of FIG. 1, after all appropriate packetmodifications are performed packet input circuit 410, packet evaluationcircuit 500 described above, or elsewhere on ASIC 100. Packet routingcircuit 420 obtains and assigns buffer numbers, in specify where tostore packets, and to inform buffer manager controller 440 how toforward the packet. Buffers assigned to bad or aborted packets arereused.

In one embodiment, packet routing circuit 420 implements queuemanagement using, for example, FIFO memories. For example, a FIFO memorymay be configured to store data subsequent to the packet polling logiccircuit, and to provide an asynchronous boundary between received packetprocessing in packet routing circuit 420 and TRAM 450 of IRAM 420 (FIG.4). Further, a FIFO memory may be used to transfer forwarding identifier(FID) and buffer number (priority and source port) information to buffermanager circuit 440 or elsewhere, to enable transmit queuing.

Buffer manager controller 440 handles transmit port queuing and rateshaping of the packet data streams. In one embodiment, buffer managercontroller 440 receives RXDONE messages from port and backplane logicblocks, each indicating a complete packet evaluation. Buffer managercontroller 440 extracts the packet's forwarding identifier (FID) andrequests a lookup from IRAM interface 450. IRAM interface 450 may beseparate from packet routing circuit 420 or may be implemented elsewherein the switch or router. In some embodiments, buffer manager controller440 is configured to perform source port suppression or to merge CPU andmonitor masks. Buffer manager controller 440 may then add packets toindividual port queues at, for example, 22 million packets per second(Mpps). In some embodiments, buffer manager controller 440 also directsport transmit activity. For example, buffer manager controller 440 mayexplicitly informs IRAM interface 450 to send packets in a particularbuffer pool data to particular ports, such as ports 485 of FIG. 4, orbackplane slots, such as slots 470 of FIG. 4. Once packets are fullydispatched, the buffers are returned to the packet freelist.

In some embodiments, buffer manager controller 440 may support inputrate shaping. Input rate shaping allows for a large number of differenttraffic classes to be defined and independently controlled based onprogrammable bandwidth limits. For example, Table 1 shows three modes ofoperation for an embodiment incorporating input rate shaping.

TABLE 1 Mode Description Port based Port based is the most basic form ofinput rate shaping. In this mode, each port's receive data is mapped toa traffic class, and each port's class can be independently controlledPort and priority based Port and priority based input rate shaping usesboth the source port number and the packet priority to create a trafficclass. In an embodiment, each port can have up to four traffic classeswithin it, and each can be independently controlled. L3/L4 info basedL3/L4 info based input rate shaping uses a field in the PRAM (TOSreplacement field) to allow software to define traffic classes based onpacket IP/IPX addresses. Because the TOS field is used, this operationis only allowed in Layer 3 and Layer 4 modes of operation, and the TOSreplacement cannot be used when using this mode.

A number of parameters I, V, C, B and T are used to configure andcontrol the input rate shaping for each class. Interval time I is theamount of time between the adding of credits for each traffic (rateshape) class. According to one embodiment of the invention, a singleinterval time applies to all traffic classes. In that embodiment, theselected interval period spans the entire range of traffic patterns toshape. In one embodiment, a maximum value of the interval time may be19.66 ms, while a minimum value, which may be a default, may be chosenas 19.2 μs. Credit value V equals to the number of bytes each creditrepresents. According to one embodiment of the invention, a singlecredit value applies to all traffic classes and may have values rangingfrom 32 to 256 bytes per credit, in powers of 2. Credit per interval Cis the amount of credit to give at the end of each interval time. Creditper interval C may be programmed to be different for each traffic class.Credits may be added to a class in two ways: fixed mode, where theprogrammed credit is stored in a rate shaper counter which isdecremented as packets arrive, or accumulate mode, where the programmedcredit is added to any credit that was left over from the previousinterval. According to an embodiment of the invention, credit perinterval C may range from 0 to 4096 in powers of 2. Maximum burst B setsthe maximum number of credits that can be accumulated for a portoperating in the accumulate mode described above. In effect, it sets amaximum burst value when a port goes from idle to sending packets.According to one embodiment of the invention, the maximum burst may beprogrammed individually for each traffic class and may range from 0 to4096 in powers of 2. Credit total T is a counter per port which keepstrack of the current amount of credit the port has for packets to passand, in one embodiment, may range from 0 to 4096 in powers of 2.

According to an embodiment, at the end of each interval time I, theinput rate shaper scans through all 128 traffic classes and either add(accumulate mode) or store (fixed mode) programmed credit C into acounter for each class. Total credit T in the counter cannot exceedmaximum burst B. As packets arrive for a given class, the input rateshaper divides the packet length by credit value V, deducts the quotientfrom total credit T in the counter for that class—if total credit T isgreater than the quotient—and allows the packet to be forwarded.Otherwise, the packet is dropped and not counted.

According to some embodiments, buffer manager controller 440 may supportoutput rate shaping in a similar fashion.

In one embodiment, TRAM interface block 450, which accepts data transferrequests from six sources and performs data transfers using a time slotdriven rotation, provides access to a wide high bandwidth memory pool inIRAM 120. The six sources are, respectively, (1) a port received packetpath request, where data and address are provided by a port receivedblock; (2) a backplane received packet path request, where data andaddress are provided by the backplane received block; (3) a buffermanager circuitry FID lookup, where a target FID is provided by thebuffer manager circuitry; (4) a buffer manager controller porttransmission request, where the buffer pool address and destinationbackplane slot are provided by the buffer manager circuitry; (5) a CPUread, where the buffer pool address is provided by a command businterface, and (6) a CPU write request, where the data and address areprovided by a command bus interface. CPU operations over a command businterface may be pipelined.

Backplane receive interface circuitry 445 receives packets from thebackplane and routes them to IRAM interface 450 and packet routingcircuit 420.

The processing of transmit packets is simpler than that of receivedpackets, since there are no CAM or PRAM lookups to perform. According toan embodiment of the invention, transmit packet processing circuit 480of FIG. 4 requests data from buffer manager controller 440 whensufficient space is available in the transmit FIFO for a given port.When a packet is available, the integrated packet controller transfers ablock of data from IRAM 120 of FIG. 1. The contents of the packet statusword header direct operation of the transmit logic circuit. Transmitpacket processing circuit 480 examines the packet header of each packetto determine the packet's length, starting offset, and the type ofpacket processing needed. Processing depends on the status bits in theheader and the port's mode of operation, and includes, for example,dynamically extending or shrinking packet data length and re-aligningdata to a quad-word (i.e., 64-bit) boundary. If the packet isVLAN-tagged (see below), processing includes inserting a VLAN ID fromthe header into the packet (if in auto or tagged mode of operation).Other processing, such as replacing the MAC destination address inpacket data with a value from the header and replacing the MAC sourceaddress in packet data with port address, are also carried out whenrequired.

Once the packet header has been processed it is passed to transmitinterface circuit 485. Transmit interface circuit 485 may be a MACinterface controller for transmission to an external MAC. Packets may betransmitted to a backplane of a switch or a router via backplanetransmit interface circuit 470 (FIG. 4).

VLAN Tagging Support

According to some embodiments, an integrated port controller such asASIC 100 of FIG. 1 supports VLAN tagging. In one embodiment, a number ofVLAN tagging modes are supported: (1) tagged only ports; (2) untaggedonly ports, (3) priority tagged only ports, (4) repeater modeauto-tagging ports (tag if necessary), (5) untagged to tagged translatormode (tagging preferred) auto-tagging ports, (6) priority-tagged totagged translator mode (tagging preferred) auto-tagging ports; (7) anduntagged to priority-tagged translator mode (priority-tagging preferred)auto-tagging ports.

Internal VLAN Table

According to some embodiments, ASIC 100 has an internal VLAN table. L2VLAN lookups are performed from the internal table. The VLAN lookup canoverride, for example, the default FID, the QOS (Quality of Service)index, and enforce per-port VLAN blocking.

Packet Priority Handling

A network device such as router 10 of FIG. 1 may allow for differentforwarding priorities of data packets. Packet forwarding priority withinrouter 10 may be established in a number of ways. Packet priority may bebased on packet evaluation parameters, such as those determined duringCAM and PRAM lookups. Additionally, priority may be affected by VLANtags and TOS (type of service) lookups.

FIG. 7 shows a process 700 for assigning packet forwarding priority,according to one embodiment of the invention. In step 710, a 2-bit portdefault priority is assigned to a packet. In step 720, the packet'spacket type modifies its packet forwarding priority. If the packet typeis IPv4, the IPv4 TOS field replaces the port default priority.Alternatively, a VLAN tag also modifies the packet forwarding priority,as shown in step 740. If a packet has a VLAN tag, its VLAN ID isextracted in step 750, and a VLAN priority is translated and replacesthe port default priority.

In step 760, the highest of the applicable priorities is selected. Thehighest priority may be the port default priority, the VLAN priority, orthe priority in the TOS field.

In step 770, the PRAM produces a 3-bit merge value. In step 780, aresulting packet priority is determined from the 3-bit merge value andthe 2-bit priority from step 760. Table 2 below lists the resultsobtained for different merge values.

TABLE 2 Merge Value Result 000 Max of (2-bit priority, 0) 001 Max of(2-bit priority, 1) 010 Max of (2-bit priority, 2) 011 Max of (2-bitpriority, 3) 100 Force to 0 101 Force to 1 110 Force to 2 111 Force to 3

Jumbo Packet Support

According to an embodiment of the invention, a network device such asrouter 10 of FIG. 1 may support jumbo packet sizes. To route jumbopackets, a buffer size (e.g., up to 15 Kybtes or higher) is set in IRAM120 to accommodate jumbo packets. Additionally, GMAC ports or back planeslots capable of sending or receiving jumbo frames are identified andenabled. Buffer manager controller 440 may be configured to enableforwarding jumbo packets to 10/100 Mbit Ethernet ports. Additionally,buffer manager controller 440 may be configured to copy a jumbo packetto the CPU if a destination is dropped because it cannot handle jumboframes.

Multicast Packet Support

A network device such as router 10 of FIG. 1 may also support broadcastor multicast packets (i.e, a received packet is replicated multipletimes and transmitted to designated ports). Multicast packets may betransmitted with different VLAN IDs. By setting a flag in the packetheader, buffer manager controller 440 recognizes the packet as amulticast packet with VLAN replication enabled. The VLAN ID in thepacket header is then treated as a multicast VLAN identifier (MID),enabling packet replication with the correct VLAN ID. In one embodiment,the MID and a transmit port number are used to compute an index into a“multicast start offset table” to obtain a replication count for thetransmit port. In this manner, the multicast can be treated differentlyfor each port. The count for each transmit port is used to index into amulticast replacement table. As the count is incremented for eachreplication, the count points to a different replacement table record inthe multicast replacement table. The replacement record provides theVLAN ID to use, the VLAN priority to use and other special instructionsfor processing the replication.

Trunking Support

In addition to the FID adjustment based on packet address and packettype, FID adjustment to support trunking can also be based on thephysical port number. In one embodiment, selected bits (e.g., bits[4:1]) of the physical port number can be used to modify the FID by anlogical 'OR. Alternatively, masked source port suppression on a per-portbasis allows portions of the port number to be ignored during segmentfiltering. Packets arriving from any of the trunked ports segmentfilters to the same destination.

Statistical Packet Sampling

A network device such as router 10 of FIG. 1 may be configured toperform statistical packet sampling to monitor and analyze networktraffic. A commonly assigned U.S. Patent Application entitled “NetworkMonitoring Using Statistical Packet Sampling,” Sunil P. Chitnis, Ian E.Davis, Jordi Moncada-Elias, Satyanarayana M. Sama, attorney docketnumber M-12611 US, filed on Mar. 26, 2002, which is hereby incorporatedby reference in its entirety, describes statistical packet sampling in anetwork device such as router 10.

Interface Adapter

According to some embodiments, an integrated port controller such asASIC 100 described above may be used with an interface adapter (IA),which is implemented in an integrated circuit such as an ASIC 800 shownin FIG. 8. ASIC 800 may provide an interface between one or moreintegrated port controllers and a backplane, as shown in FIG. 3B. Forexample, ASIC 800 may provide an interface between four integrated portcontrollers and seven backplane slots.

An interface adapter such as ASIC 800 may be used to transmit data whenmore than one integrated port controller such as ASIC 100 of FIG. 1 isconfigured to route data to and from a backplane on a network devicesuch as router 10. The interface adapter can manage bandwidth differencebetween multiple port controllers such as ASIC 100 and the backplane ofthe network device. By providing an interface adapter such as ASIC 800,a higher density per line card may be achieved.

Integrated Port Controller Receive Interface Block

An integrated port controller receive interface block 810 interfaceswith an integrated port controller such as ASIC 100 of FIG. 4. Accordingto an embodiment, block 810 receives data from an integrated portcontroller on a 32-bit data bus. Block 810 also receives a 3-bit header,and a destination port number. The destination port number specifieswhich of the ports or backplane slot the 32-bit data should be sent.Data packets received in block 810 can be transmitted to one or morebackplane queues 815. Backplane queues 815 transmit data packets to abackplane transfer interface block 830.

Integrated Port Controller Transmit Interface Block

Similarly, an integrated port controller transmit interface block 820interfaces with an integrated port controller such as ASIC 100 of FIG.4. According to an embodiment, block 820 transmits data to an integratedport controller using a 32-bit data bus. Block 820 also transmits a3-bit header, and a source port number. The source port number specifieswhich of the ports or backplane slot the 32-bit data originated.

Backplane Transmit Interface Block

Backplane transmit interface block 830 interfaces with a backplane on anetwork device such as router 10 of FIG. 1. According to an embodiment,block 830 transmits data to the backplane using a 64-bit data bus. Block830 also transmits a 6-bit header, and a 3-bit slot number thatidentifies the destination slot for the data.

Backplane Receive Interface Block

Similarly, a backplane receive interface block 840 interfaces with abackplane on a network device such as router 10 of FIG. 1. According toan embodiment, block 840 receives data from the backplane using a 64-bitdata bus. Block 840 also receives a 6-bit header, and a 3-bit slotnumber that identifies the source of the data.

Buffer Manager

Interface adapter 800 includes a buffer manager 850. Buffer manager 850manages one or more buffers, which receive incoming data from thebackplane. According to an embodiment, buffer manager 850 managesbuffers that are 256 bytes wide and support 512 KB of data.

Buffers are allocated using a free buffer list. According to anembodiment, the free buffer list is a 2048-entry circular queueinitialized by software during a software reset initialization. Buffermanager 850 allocates a new buffer when the start of a packet isdetected from any backplane slot, and when the first bytes arrive from aslot needing another buffer to accommodate the remaining portion of thepacket. When a buffer is full, or an end of packet is detected, theheader queues corresponding to that packet are updated, as isinformation in the usage buffer. According to an embodiment, the usagebuffer is 2K by 4 bits, where the 4 bits each correspond to anintegrated port controller that the buffer contents may be sent to. Whenthe header queue is updated, the buffer entry in the usage buffer isupdated with information from an FID RAM, indicating which integratedport controller the buffer contents will be sent to.

Buffer manager 850 controls the header queues. According to anembodiment, there are 28 header queues, each corresponding to acombination including one of seven backplane source slots and one offour integrated port controllers. Each of the 28 header queues contains1024 entries. When a header queue fills up, buffer manager 850 sends ahold request to the corresponding backplane slot. A header queue entryis updated when a buffer fills up or when an end of packet is detected.

Backplane RAM Control Interface Block and Backplane Data RAM

According to an embodiment, a backplane RAM control interface block 860provides an interface to a backplane data RAM 870. Data arrives from thebackplane during each cycle. Backplane receive interface block 840 packstwo 64-bit data blocks to form a line, which is written to backplanedata RAM 870. The data, as well as an address, are sent to backplanedata RAM 870. According to an embodiment, this write request isconsidered the highest request and the controller guarantees that therequest is honored every time. A FIFO is not used between backplanereceive interface block 840 and backplane RAM control interface block860, since the write requests are always honored and never delayed ordropped. Data received from the backplane is stored in one or morebackplane queues 880.

Backplane RAM control interface block 860 is also responsible forinterfacing with the read queues which contain addresses from which toread data and place in queues going to integrated port controllertransmit interface blocks 820. Buffer manager 850 provides source slotnumber and header information corresponding to the data to be read fromintegrated port controller transmit interface block 820 to the backplaneRAM control interface block 860. Unlike write requests, read requestsare arbitrated in a round-robin scheme. When no data is being sent fromthe backplane, all of the bandwidth is available to process readrequests.

CPU Interface

Interface adapter 800 may interface with a CPU such as CPU 300 of FIG. 1via a command bus, which may be a purely asynchronous bus.

While particular embodiments of the present invention have been shownand described, it will be obvious to those skilled in the art thatchanges and modifications may be made without departing from thisinvention in its broader aspects and, therefore, the appended claims areto encompass within their scope all such changes and modifications asfall within the true spirit and scope of this invention.

1. A method comprising: receiving a data packet over a port of thenetwork device; determining, by the network device, a forward identifierfor the data packet; selecting, by the network device, one or more bitsof a port number associated with the data packet; performing, by thenetwork device, a logical operation between the one or more selectedbits and the forward identifier to generate a modified forwardidentifier; and using, by the network device, the modified forwardidentifier for trunking.
 2. The method of claim 1 wherein the logicaloperation is an OR operation.
 3. A device comprising: a set of ports forreceiving and forwarding one or more data packets, from the device; amemory; and a controller adapted to: determine a forward identifier fora data packet received by the device; select one or more bits of a portnumber associated with the received data packet; perform a logicaloperation between the one or more selected bits and the forwardidentifier to generate a modified forward identifier; and use themodified forward identifier for trunking.
 4. The device of claim 3wherein the logical operation is an OR operation.
 5. The method of claim1 wherein the using comprises performing a lookup in a memory in thenetwork device using the modified forward identifier.
 6. The device ofclaim 1 wherein the network device is adapted to perform a lookup in thememory using the modified forward identifier.